Method for providing delivery item information and apparatus therefor

ABSTRACT

The present disclosure provides a method and system for allowing a receiver of a delivery item to view moving picture corresponding to the delivery item attached on the delivery item in an augmented reality form without unpacking the delivery item so as to allow to intuitively check the information of the delivery item. According to an aspect of an exemplary embodiment, a method of providing delivery item information in a device includes: activating a camera when an application program is executed; recognizing an identification code attached on a delivery item and photographed by the camera; requesting moving picture data corresponding to the identification code from a service server and receiving the moving picture data; and outputting moving picture corresponding to the moving picture data by superimposing on a real-time camera image acquired by the camera.

CROSS-REFERENCE TO RELATED APPLICATION

The present application claims priority to Korean Patent Application No.10-2017-0068492, filed on Jun. 1, 2017, in the Korean IntellectualProperty Office, which is incorporated herein in its entirety byreference.

TECHNICAL FIELD

The present disclosure relates to a method and apparatus for providingdelivery item information. More particularly, the present disclosurerelates to a method and system for allowing a receiver of a deliveryitem to view moving picture corresponding to the delivery item in anaugmented reality form without unpacking the delivery item so as toallow to intuitively check the information of the delivery item.

BACKGROUND

The description in this section merely provides background informationof embodiments of the present disclosure and is not intended to specifyprior arts of the present disclosure.

As non-face-to-face transactions such as Internet shopping and homeshopping are increasing, delivery services such as a postal parcelservice, courier, and air cargo service are also expanding. According tocurrent delivery services, the sender packs a delivery item in a paperbox or plastic wrapping material to prevent the damage of the deliveryitem and attaches a waybill on an outer surface of a package, so that acarrier ships and delivers the delivery item package with reference tothe waybill.

Generally, a barcode is printed on the waybill, and a delivery personresponsible for the delivery item and records each step of a deliveryprocess by scanning the barcode using a barcode scanner while performingthe delivery process of the delivery item.

However, the conventional waybill has a problem that personalinformation of the receiver is printed on the waybill in addition to thebarcode, and the information of the receiver may be exposed to many andunspecified persons during the delivery.

On the other hand, the delivered item remains in a state where it isdifficult to check the contents through the box or plastic package evenafter the delivery is completed unless the packaging is removed. Thus,in case that the receiver of the delivery item is not the same as theorderer, the receiver may happen to receive an undesired item.Meanwhile, the orderer having received an ordered item cannot check acondition of the item before the packaging is removed.

Various computer systems for facilitating shipment and delivery of thedelivery packages have been disclosed. For example, Korean laying-openpatent publication No. 2014-31611 entitled HOME DELIVERY SYSTEMdiscloses a delivery system in which a device that scans a waybilltransmits an identification code to a server to receive a deliveryaddress and automatically input the delivery address into a navigationprogram to improve work efficiency. However, the conventional systemsand methods are focused on improvement of the work efficiency and arenot concerned with showing contents or condition of the delivery itempackages.

SUMMARY

Provided are a method and apparatus, which allow a shipper or sender toattach an identification code on which personal information is notexposed, discriminate a legitimate receiver who photographs theidentification code and request information related to the deliveryitem, and provide the legitimate receiver with moving picture datacorresponding to the identification code.

Provided are a method and apparatus which allow the receiver of thedelivery item package to intuitively and easily view the moving picturecorresponding to the delivery item by only photographing theidentification code attached on the delivery item package.

Provided are a method and apparatus which allow the receiver of thedelivery item package to view the moving picture corresponding to thedelivery item in an augmented reality form at a receiver device andprovide unusual experience to the receiver user.

Additional aspects will be set forth in part in the description whichfollows and, in part, will be apparent from the description, or may belearned by practice of the presented exemplary embodiments.

According to an aspect of an exemplary embodiment, a method of providingdelivery item information in a device includes: activating a camera whenan application program is executed; recognizing an identification codeattached on a delivery item and photographed by the camera; requestingmoving picture data corresponding to the identification code from aservice server and receiving the moving picture data; and outputtingmoving picture corresponding to the moving picture data by superimposingon a real-time camera image acquired by the camera.

The moving picture data may include at least one of: detailedinformation of the delivery item, advertisement information related withthe delivery item, and information designated by a user who ordered thedelivery item.

The operation of outputting the moving picture may include: searching aposition of a marker in the identification code in the real-time cameraimage; setting a playback frame according to the position of the marker;and indicating the playback frame in the real-time camera image andoutputting the moving picture by superimposing the moving picture in theplayback frame.

The operation of setting the playback frame may include an operation oftracking the position of the marker that changes as the camera moves totranslate or rotate the playback frame according to movement of themarker.

The operation of outputting the moving picture may include: determiningwhether a designated area exists in the moving picture; and, when it isdetermined that the designated area exists in the moving picture,receiving a predetermined data from the service server and outputtingthe predetermined data by superimposing on the designated area.

The operation of requesting and receiving the moving picture data mayinclude: transmitting user identification information to the serviceserver and receiving the moving picture data corresponding to the useridentification information.

The user identification information may include at least one of a phonenumber assigned to the device, facial identification informationrecognized through a front camera, and biometric information recognizedthrough a biometric module.

The operation of requesting and receiving the moving picture data mayinclude: receiving a moving picture list corresponding to theidentification code from the service server; displaying the movingpicture list by combining the moving picture list with the real-timecamera image; and, in response to a user input choosing a specificmoving picture, requesting the requesting specific moving picture datacorresponding to the specific moving picture from a service server andreceiving the specific moving picture data. In such a case, the specificmoving picture received from the service server may be output bysuperimposing on the real-time camera image.

According to another aspect of an exemplary embodiment, a method ofproviding delivery item information in a service server includes:receiving, from a device, a request for moving picture datacorresponding to an identification code attached on a delivery item andphotographed by a camera of the device as an application program isexecuted; determining a moving picture corresponding to theidentification code; and transmitting the moving picture datacorresponding to a determined moving picture to the device.

The operation of determining the moving picture may include: checkinguser identification information of the device; and choosing thedetermined moving picture according to the user identificationinformation among a plurality of moving pictures corresponding to theidentification code.

The user identification information may be received from the device ormay be determined by using the user identification information.

The operation of determining the moving picture may include:transmitting a moving picture list to the device when there are aplurality of moving pictures corresponding to the identification code;and receiving, from the device, the request for the moving picture datafor a specific moving picture chosen from the moving picture list as thedetermined moving picture.

According to an aspect of an embodiment, provided is a non-transitorycomputer-readable storage medium having stored therein a program which,when executed by a processor, causes the processor to perform the methodof providing delivery item information.

According to an aspect of an exemplary embodiment, an apparatus forproviding delivery item information includes: a camera control moduleconfigured to activate a camera when an application program is executedand photograph an identification code attached on a delivery item; andan application control module configured to recognize the identificationcode, request moving picture data corresponding to the identificationcode from a service server, receive the moving picture data from theservice server, and control a display operation such that a movingpicture corresponding to the moving picture data is superimposed on areal-time camera image acquired by the camera.

According to another aspect of an exemplary embodiment, an apparatus forproviding delivery item information includes: a moving picture datacontrol module configured to generate and maintain moving picture datacorresponding to an identification code; and a service control moduleconfigured to receive, from a device, a request for moving picture datacorresponding to the identification code attached on a delivery item andphotographed by a camera of the device, determine a moving picturecorresponding to the identification code, and transmit the movingpicture data corresponding to a determined moving picture to the device.

According to the present disclosure, the receiver may safely receive thedelivery item without exposure of the personal information since thepersonal information may not be exposed on the delivery item package.

Also, the receiver may intuitively and easily view the moving picturecorresponding to the delivery item and check the contents and conditionof the delivery item by only photographing the identification codeattached on the delivery item package.

Further, since the receiver of the delivery item package may view themoving picture corresponding to the delivery item in an augmentedreality form at the receiver device, the user may enjoy a unusualexperience.

The present disclosure may provide an advertisement moving picturecorresponding to the delivery item, and thus may increase theeffectiveness of the advertisement and provide a new advertising medium.

Various advantageous effects other than those described above may bedisclosed explicitly or implicitly in the following descriptions ofembodiments according to the present disclosure.

Further areas of applicability will become apparent from the descriptionprovided herein. It should be understood that the description andspecific examples are intended for purposes of illustration only and arenot intended to limit the scope of the present disclosure.

DRAWINGS

In order that the disclosure may be well understood, there will now bedescribed various forms thereof, given by way of example, referencebeing made to the accompanying drawings, in which:

FIG. 1 is a block diagram of a system for supporting a method ofproviding delivery item information according to an embodiment of thepresent disclosure;

FIG. 2 is a flowchart illustrating the method of providing the deliveryitem information according to an embodiment of the present disclosure;

FIG. 3 is a block diagram of a device according to an embodiment of thepresent disclosure;

FIG. 4 is a flowchart illustrating a method of providing the deliveryitem information in the device according to an embodiment of the presentdisclosure;

FIG. 5 is a flowchart illustrating the method of providing the deliveryitem information in the device according to another embodiment of thepresent disclosure;

FIG. 6 is a flowchart illustrating the method of providing the deliveryitem information in the device according to yet another embodiment ofthe present disclosure;

FIG. 7 is a block diagram of a service server according to an embodimentof the present disclosure;

FIG. 8 is a flowchart illustrating a method of providing the deliveryitem information in the service server according to an embodiment of thepresent disclosure;

FIG. 9 is a flowchart illustrating the method of providing the deliveryitem information in the service server according to another embodimentof the present disclosure; and

FIG. 10 is a block diagram illustrating an operating environment of adevice for providing the delivery item information according to anembodiment of the present disclosure.

The drawings described herein are for illustration purposes only and arenot intended to limit the scope of the present disclosure in any way.

DETAILED DESCRIPTION

Reference will now be made in detail to exemplary embodiments, examplesof which are illustrated in the accompanying drawings, wherein likereference numerals refer to like elements throughout.

In the following description and the accompanied drawings, detaileddescriptions of well-known functions or configuration that may obscurethe subject matter of the present disclosure will be omitted forsimplicity. It is to be noted that the same components are designated bythe same reference numerals throughout the drawings.

The terms and words used in the following description and drawings arenot necessarily to be construed in an ordinary sense or a dictionary,and may be appropriately defined herein to be used as terms fordescribing the present disclosure in the best way possible. Such termsand words should be construed as meaning and concept consistent with thetechnical idea of the present disclosure.

The configurations of embodiments described in this specification orshown in the drawings are merely the most preferred embodiments of thepresent disclosure, and do not limit the technical ideas of the presentdisclosure. Therefore, it should be understood that there are variousequivalents and modifications that may replace the configurations of theembodiments.

The terminologies including ordinals such as “first” and “second” usedto explain various elements in this specification may be used todiscriminate an element from the other ones or for simplicity. Forexample, a second component may be referred to as a first component, andsimilarly, a first component may also be referred to as a secondcomponent without departing from the scope of the present disclosure.

When an element is referred to as being “connected” or “coupled” toanother element, it means that it is logically or physically connectedor it may be connected to the other element. In other words, it is to beunderstood that although an element may be directly connected or coupledto another element, there may be other elements therebetween, or elementmay be indirectly connected or coupled to the other element.

The terminology used herein is for the purpose of describing particularembodiments only and is not intended to be limiting of the disclosure.The singular forms include plural referents unless the context clearlydictates otherwise. Also, The expressions “˜comprises,” “˜includes,”“˜constructed,” “˜configured” are not to be construed as being equippedwith all the components, processing steps, or operations described inthis specification, but some of the components, the processing steps, orthe operations may not be included and additional elements may beincorporated further.

The embodiments within the scope of the present disclosure includecomputer-readable media having or carrying computer executableinstructions or data structures stored in computer-readable media. Suchcomputer-readable media may be an arbitrary media that is accessible bya general purpose or special purpose computer system. Thecomputer-readable media may include, but is not limited to, a physicalstorage media such as RAM, ROM, EPROM, CD-ROM, other optical diskstorage, a magnetic disk storage, and other magnetic storage devices.The computer-readable media may be used to store or deliver certainprogram code means in the form of computer-executable instructions,computer-readable instructions, or data structures.

In the following descriptions including the claims, the term “network”is defined as one or more data links that enable exchange of electronicdata between computer systems and/or modules. When information istransmitted or provided to a computer system through a network or othercommunication connection, the connection may be understood as acomputer-readable medium. The computer readable instructions include,for example, instructions and data that cause a general purpose computersystem or a specific purpose computer system to perform a particularfunction or group of functions. The computer executable instructions maybe binary format instructions or intermediate format instructionswritten in, for example, the assembly language or high level languages.

The present disclosure may be practiced in a networked computingenvironment including at least one of various types of computing systemssuch as a personal computer, a laptop computer, a handheld device, amultiprocessor system, a microprocessor-based or programmable consumerelectronics, a network PC, a minicomputer, a mainframe computer, apager, and so on. Also, the present disclosure may be practiced indistributed system environment where both a local and a remote computersystems linked by wired data links, wireless data links, or acombination of wired and wireless data links over a network performtasks. In a distributed system environment, the program modules mayreside in local and remote storage devices.

Hereinbelow, described are a method of providing delivery iteminformation according to an embodiment of the present disclosure, and adevice and system for implementing the method.

First, a system for supporting the method of providing the delivery iteminformation according to an embodiment of the present disclosure willnow be described in detail.

FIG. 1 is a block diagram of the system for supporting the method ofproviding the delivery item information according to an embodiment ofthe present disclosure.

Referring to FIG. 1, the system for supporting the method of providingthe delivery item information according to an embodiment of the presentdisclosure may include a device 100 and a service server 200.Additionally, the system of the present disclosure may further includeat least one affiliated server 300 such as a server suitable forreceiving moving picture data from the device 100 to store in apredetermined storage space allocated to the corresponding device 100and a shipping system server that may be linked to the service server200.

The device 100 refers to a user device suitable for transmitting andreceiving various data through a communications network 400 in responseto an operation of the user. The device 100 may perform voice or datacommunications through the communications network 400 and may exchangevarious information with the service server 200. The device 100 mayinclude a browser for transmitting and receiving information, a memoryfor storing programs and protocols, and a microprocessor for executingprograms for calculation and control purposes.

In particular, the device 100 according to the present embodiment mayexecute an application program which may communicate with the serviceserver 200. When a camera mounted in the device 100 is activated by theapplication program, the device 100 may photograph an identificationcode attached on a delivery item package through the activated camera.Here, the delivery item refers to an item having been shipped by aseller, for example, and is being delivered by courier or mail, and isgenerally in a condition where it is difficult to check the contentsthrough a box or plastic package. According to the present disclosure,the identification code is attached on the delivery item package so asto allow checking information about the delivery item before thepackaging is removed. The device 100 may photograph and recognize theidentification code attached on the delivery item package, and requestmoving picture data corresponding to the identification code from theservice server 200.

The identification code may be a simple one-dimensional barcode, atwo-dimensional barcode such as a QR code, a color bar code, or anyother variant of them. In the present disclosure, it is assumed that theidentification code has a form of the QR code or the other kind of thetwo-dimensional barcode. The QR code is a type of matrix barcodeconsisting of back squares arranged in a square grid on a whitebackground, and may store up to 7,089 numeric characters, 4,296alphanumeric characters, or 1,817 Kanji characters. Because of the largeamount of data that can be stored, the QR code has an advantage of beingable to store Internet universal resource locator (URL), still image andmoving picture, map, and business card information, and is widely beingused as an advertisement or marketing tool in addition to a traditionalusage of product identification in a store or a factory. According tothe present disclosure, moving picture data is not stored in thetwo-dimensional barcode but is maintained in the service server 200, andthe two-dimensional barcode carries the Internet URL for accessing themoving picture data in the service server 200, so that the device 100having photographed and recognized the identification code may accessthe moving picture data.

The moving picture data corresponding to the identification code maycontain information about the delivery item. For example, the movingpicture data may include a instruction manual of the delivery item oranother information related to the delivery item such as how to assemblethe item. Also, the moving picture data may include an advertisement ofthe delivery item, a corporate advertisement of the manufacturer of thedelivery item, or other kinds of marketing information. Further, themoving picture data may include a message from a user who ordered thedelivery item.

When receiving the moving picture data from the service server 200, thedevice 100 may superimpose a moving picture corresponding to receivedmoving picture data on an image photographed by the activated camera. Inother words, the device 100 according to the present disclosure outputsthe moving picture corresponding to the identification code in anaugmented reality form which combines the moving picture with the realimage being photographed by the camera, so that a user may see themoving picture corresponding to the identification code lively and checkthe item in the delivered package realistically. When the moving pictureis output in the augmented reality, the moving picture may be changedaccording to a movement and orientation of the device 100 to enhanceliveliness of the augmented reality.

The operation of the device 100 will be described below in detail. Thedevice 100 according to embodiments of the present disclosure may beimplemented in various forms. For example, the device 100 may be amobile device such as a smartphone, a tablet PC, a personal digitalassistant (PDA), a portable multimedia player (PMP), or a fixed devicesuch as a smart TV and a desktop computer.

Even though it is impossible to enumerate all types of devices inconsideration of convergence trend of digital devices, any device unitequivalent to the device units mentioned above may be used as the device100. Also, any device unit capable of communicating with the serviceserver 200 and the affiliated server 300 through the communicationsnetwork 400 may be used as the device 300 according to the presentdisclosure.

Although just a single device 100 is shown in FIG. 1, there may be aplurality of the devices 100, in the system, that communicate with theservice server 200. Also, the user who ordered the delivery item may bedifferent from the user who received the delivery item. Hereinbelow, theembodiments of the present disclosure will be described in terms of thedevice 100 of a receiver who receives the delivery item for convenienceof description. If it is necessary to discriminate the devices of anorderer and the receiver, the terms “orderer device” and “receiverdevice” will be used. Even in such a case, however, the orderer devicemay be the same device as the receiver device from a hardware point ofview.

The service server 200 supports a service of providing the delivery iteminformation according to an embodiment of the present disclosure.Specifically, the service server 200 may generate, store, and maintainthe moving picture data corresponding to the identification code. Inparticular, in case that the moving picture data is a user-designatedmessage produced by the user, the service server 200 may provide variousservices to the device (e.g. the orderer device) to allow the user toproduce or generate the corresponding moving picture data. In addition,the identification code of the present disclosure may be printed in aform of a waybill so as to be attached on the package to be delivered bythe courier or the mail.

The service server 200 may generate the identification code and transmitthe identification code to the affiliated server 300, so that theoperator of the affiliated server 300 may print the identification codeand attach on the package. However, the service server 200 may print theidentification code, by itself, to be attached on the package, andtransmit the identification code to the device 100.

In the case that the moving picture data is the advertisement of thecorresponding delivery item, the service server 200 may identify theuser who watched the advertisement and control the process so that acompensation is provided to the user. Also, the service server 200 maysupport a process of creating, producing, and distributing theapplication program for performing the operations described above.

The service server 200 may be an online shopping mall server, or may bea separate server that is interfaced with the online shopping mallserver and performs the operations described above.

The configurations and operations of the device 100 and the serviceserver 200 will be described below in detail. A processor mounted ineach device according to an embodiment of the present disclosure mayexecute program instructions for performing the method according to thepresent disclosure. The processor may be a single-threaded processor.Alternatively, however, the processor may be a multithreaded processor.The program instructions executed by the processor may be stored on amemory or storage device.

The device 100, the service server 200, and the affiliated server 300according to an embodiment of the present disclosure exchange variousinformation through the communications network 400. The communicationsnetwork 400 may be a wireless network adopting a wireless communicationscheme such as wireless local area network (WLAN), Wi-Fi, wirelessbroadband Internet (Wibro), Worldwide Interoperability for MicrowaveAccess (WiMAX), and High Speed Downlink Packet Access (HSDPA). However,the present disclosure is not limited thereto, but the communicationsnetwork 400 may be a wired network adopting a communication scheme suchas Ethernet, Digital Subscriber Line (xDSL) such as Asymmetric DigitalSubscriber Line (ADSL) and Very High Bitrate Digital Subscriber Line(VDSL), Hybrid Fiber Coaxial Cable (HFC), Fiber-to-the-Curb (FTTC), andfiber-to-the-home (FTTH).

Also, the communications network 400 includes a plurality of accessnetworks (not shown) and a core network (not shown), and may furtherinclude an external network such as Internet (not shown). The accessnetwork (not shown), which allows the device 100 to connected to thecore network, may include a plurality of base stations such as atraditional base station (BS), a base transceiver station (BTS), a NodeB (or NodeB), an Evolved Node B (eNodeB), and a plurality of basestations such as a traditional Base Station Controller (BSC) or a RadioNetwork Controller (RNC). Meanwhile, a digital signal processing unitand a radio signal processing unit integrally implemented in the basestation may be divided into a digital unit (as DU) and a radio unit(RU), so that each of a plurality of RUs are provided in respective oneof a plurality of areas, and the plurality of RUs) are connected to acentralized DU.

The core network, which performs main functions for mobile communicationservices such as mobility control and switching among the accessnetworks, performs circuit switching or packet switching operations andmanages and controls packet flow in the communications network 400.Also, the core network allows inter-frequency mobility and may play arole for interworking traffics in the access network and the corenetwork with another network such as Internet. The core network mayfurther include at least one of: a Serving Gateway (SGW), a Packet DataNetwork (PDN) Gateway, a Mobile Switching Center (MSC), a Home LocationRegister (HLR), a Mobile Management (MME), and a Home Subscriber Server(HSS).

The Internet (not shown), which refers to a public network that allowsinformation exchange according to a TCP/IP protocol, is connected to theservice server 200 and may provide information provided by the serviceserver 200 to the device 100 via the core network and the access networkand provide information from the device 100 to the service server 200via the core network and the access network.

Now, described is an overall process of providing the delivery iteminformation according to an embodiment of the present disclosure.

FIG. 2 is a flowchart illustrating the method of providing the deliveryitem information according to an embodiment of the present disclosure.

It is assumed that the user of the device 100 have received the deliveryitem before the procedure shown in FIG. 2 is initiated. Here, thedelivery item, which refers to an item being delivered by courier ormail and of which package is unpacked yet, is generally in a conditionwhere it is difficult to check the contents through the box or plasticpackage. Also, the identification code is attached on the delivery itempackage.

In response to an input of the user having received the delivery item,the device 100 may execute the application program installed previously(S101). While the application is being executed, the camera may beactivated in response to a selection input of the user (S103).Alternatively, the camera may be activated automatically at the sametime as the execution of the application program according to a settingof the application program.

The user of the device 100 may place the device 100 of which camera isactivated on the identification code and photograph the identificationcode (S105). Here, the photographing of the identification code mayinclude a process of aligning the device 100 with the identificationcode so that the identification code is placed within a predeterminedframe of the camera, and may include a process of pressing aphotographing button of the camera. At this time, a separate guide markmay be displayed on the activated camera to facilitate positioning ofthe identification code within the frame of the camera, and the user maymove the device 100 in such a direction that the identification codeenters the frame following the guide mark.

After the identification code is photographed through this process, thedevice 100 may recognize the identification code. The recognition of theidentification code may include an operation of detecting a URLcorresponding to the identification code. Also, the recognition of theidentification code may include an operation of recognizing the serviceserver 200 maintaining the identification code. The recognition of theidentification code may include another operation required forrequesting the moving picture data from the service server 200.

After the identification code is recognized, the device 100 may requestthe moving picture data corresponding to the identification code fromthe service server 200 (S107). At this time, the device 100 may transmitthe URL of the moving picture data extracted from the identificationcode to the service server 200, or may transmit the recognizedidentification code to the service server 200 in an image form.

The service server 200, which maintains the identification code and themoving picture data and stores the moving picture data corresponding tothe identification code in advance, finds the moving picture datacorresponding to the identification code in response to the request ofthe device 100 (S109) and transmit the moving picture data found in theoperation S109 to the device 100 (S111).

The service server 200 of the present disclosure may download a file ofthe moving picture data to the device 100 as a whole. Alternatively, theservice server 200 may transmit the moving picture data to the device100 in streaming fashion.

The device 100 waits for a response from the service server 200 in astate that the device continues to execute the application program andthe camera is activated. Upon receiving the moving picture data from theservice server 200, the device 100 may superimpose the moving picturecorresponding to received moving picture data on an image beingphotographed by the camera to output the moving picture in an augmentedreality form (S113).

The moving picture data received from the service server 200 may includeat least one of: advertisement information related with the deliveryitem such as the advertisement of the delivery item, the corporateadvertisement of the manufacturer of the delivery item, and anadvertisement of a related product; detailed information of the deliveryitem such as the instruction manual of the delivery item, specificationsof the delivery item, and order details; and information designated bythe orderer such as a message card of the orderer.

Thus, according to the present disclosure, the user of the device 100may easily check the information about the delivery item, withoutunpacking the package, through the moving picture reproduced after therecognition of the identification code. Also, the user may view theinstruction manual of the delivery item intuitively through the movingpicture, and may receive a lively message from the gift provider in thecase that the delivery item is a gift.

The method of providing the delivery item information according to anembodiment of the present disclosure will be described in more detail.

FIG. 3 is a block diagram of the device 100 according to an embodimentof the present disclosure.

Referring to FIG. 3, the device 100 may include a camera control module110, a service server interface module 120, an application controlmodule 130, and a user authentication module 140.

Here, the term “module” is used herein to refer to an entity performingrespective operation and being implemented by hardware, software, or acombination thereof. For example, the “module” may be a program moduleexecuted by a processor to carry out a predetermined function, and mayinclude one or more components such as software components,object-oriented software components, class components, and taskcomponents, and may include processes, functions, attributes,procedures, subroutines, segments of program code, drivers, firmware,micro codes, circuits, data, a database, data structures, tables,arrays, or variables. Also, a function provided by the a component and a“module” may be implemented by a combination of smaller components and“modules” or may be divided into additional components and “modules.”

The camera control module 110 may activate the camera under a control ofthe application control module 130. Also, the camera control module 110may provide the guide mark on a real-time camera image displayed on thedevice 100 to facilitate positioning of the identification code withinthe frame of the camera. If the identification code is positioned insidethe frame of the camera, the camera control module 110 may recognize theidentification code. The camera control module 110 may extract theidentification code itself or another information (e.g. the URL) for usein accessing the moving picture data corresponding to the identificationcode, and may transfer the extracted information to the applicationcontrol module 130.

The camera control module 110 may control the operation of superimposingthe moving picture from the service server 200 on the real-time cameraimage displayed on the device 100 under the control of the applicationcontrol module 130. At this time, the camera control module 110 maysearch a marker in the identification code in the real-time camera imageand transmit position information of the marker to the applicationcontrol module 130, and then control the operation of superimposing themoving picture on the real-time camera image under the control of theapplication control module 130. If the user fails to align the device100 with the identification code and thus the marker in theidentification code is not recognized in the real-time camera image, thecamera control module 110 may inform the user that an alignment isrequired. Further, the camera control module 110 may perform anotheroperations required to superimpose the moving picture on the real-timecamera image.

In addition, the camera control module 110 may control an imageprocessing operation, under the control of the application controlmodule 130, such that the moving picture is rotated, translated, ormodified according to the position and orientation of the marker in theidentification code.

Meanwhile, the camera control module 110 may detect, under the controlof the application control module 130, whether there is a designatedarea in the moving picture that is output in combination with thereal-time camera image. If there is the designated area, the cameracontrol module 110 may superimpose prescribed data on the designatedarea under the control of the application control module 130.

The camera control module 110 may control the camera installed in thedevice 100. Here, the device 100 may be configured to include a frontcamera and a rear camera. The camera control module 110 may control theoperation of photographing and recognizing the identification codethrough the rear camera, and may perform an operation of recognizing theface of the user through the front camera.

The service server interface module 120 performs a process ofinterfacing with the service server 200. In particular, the serviceserver interface module 120 may transmit a request for the movingpicture data corresponding to the identification code recognized by thecamera control module 110, and receive the moving picture data from theservice server 200 to transfer to the application control module 130.

Besides, the service server interface module 120 may transmit andreceive various information to and from the service server 200 throughthe communications network 400.

The application control module 130 performs overall control over theprocess of providing delivery item information according to theembodiment of the present disclosure. The application control module 130controls the execution of the application program according to themanipulation of the user. While the application program is beingexecuted, the application control module 130 may control variousoperations performed by the application program. In particular, theapplication control module 130 may control the camera control module 110to activate the camera and recognize the identification code attached onthe delivery item package.

Upon receiving the identification code from the camera control module110, the application control module 130 may transmit the request for themoving picture data corresponding to the identification code to theservice server 200 through the service server interface module 120. Whenthe moving picture data corresponding to the identification code isreceived from the service server 200 through the service serverinterface module 120, the application control module 130 may transferthe moving picture data to the camera control module 110 and the cameracontrol module 110 to superimpose the moving picture on the real-timecamera image.

The application control module 130 may support a process of uploadingthe moving picture data received from the service server 200 to theaffiliated server 400 specified by the user in advance. For example, theapplication control module 130 may support a process of uploading themoving picture data to a personal media service server such as a socialnetwork service (SNS) server in which the user is subscribed.

Also, the application control module 130 may receive, from the serviceserver 200, a list of moving pictures corresponding to theidentification information and output a moving picture list to invitethe user to choose a certain moving picture. Additionally, theapplication control module 130 may send user identification informationextracted by the user authentication module 140 to the service server200, or may support a process of checking whether the user is anauthorized user before the moving picture is output by the cameracontrol module 110. These operation of the application control module130 will be described below in more detail.

The user authentication module 140 may perform an operation of acquiringthe user identification information. The user identification informationis information suitable for use in discriminating a user from the otherusers, and may include at least one of a phone number assigned to thedevice, facial identification information recognized through the frontcamera, and biometric information recognized through a biometric module.However, the present disclosure is not limited thereto, and the useridentification information may be any other information that can be usedto identify the user.

A user verification process may be performed by the device 100 or by theservice server 200. In case that the user verification process isperformed by the device 100, the user authentication module 140 mayextract the user identification information from the identification codeand determine whether the user is an authorized user by comparing theuser identification information extracted from the identification codewith identification information of the user of the device 100.Meanwhile, in case that the user verification process is performed bythe service server 200, the user authentication module 140 may transmitthe user identification information of the user to the service server200 so that the service server 200 carries out the user verificationprocess.

The method of providing the delivery item information in the device 100according to embodiments of the present disclosure will be described inmore detail with reference to attached drawings.

FIG. 4 is a flowchart illustrating a method of providing the deliveryitem information in the device according to an embodiment of the presentdisclosure.

It is assumed that the user of the device 100 have received the deliveryitem by courier or mail before the procedure shown in FIG. 4 isinitiated. In order that the user may check the contents withoutunpacking the package, the device 100 may execute the applicationprogram in response to an input of the user (S201)

While the application is being executed, the camera may be activated inresponse to a selection input of the user (S203). Alternatively, thecamera may be activated automatically at the same time as the executionof the application program according to a setting of the applicationprogram.

The user of the device 100 may place the device 100 of which camera isactivated on the identification code and photograph the identificationcode (S205).

Subsequently, the device 100 may extract the user identificationinformation from the identification code (S207), and determine whetherthe user is an authorized user by comparing the user identificationinformation extracted from the identification code with theidentification information of the user (S209).

For example, in case that the user identification information extractedfrom the identification code is the phone number, the device 100 maycompare the phone number assigned to the device 100 with the useridentification information. In case that the user identificationinformation extracted from the identification code is the facialrecognition information, the device 100 may recognize facial informationof the user from a picture photographed by the front camera and comparethe facial recognition information acquired through the front camerawith the facial recognition information extracted from the useridentification information. In case that the user identificationinformation extracted from the identification code is the biometricinformation such as a fingerprint, the device 100 may activate abiometric module of the device to receive biometric information of theuser and compare the acquired biometric information with the biometricinformation in the user identification information.

If it is determined in the above process that the user is an authorizeduser, the device 100 may request the moving picture data correspondingto the identification code from the service server 200 and receive themoving picture data from the service server 200 (S211).

Here, the device 100 may check whether the user is an authorized userafter receiving the moving picture data corresponding to theidentification code from service server 200 depending on theimplementations.

Afterwards, the device 100 may superimpose the moving picture data onthe real-time camera image to output the moving picture in the augmentedreality form (S213).

At this time, the device 100 may track the marker in the identificationcode to carry out operations of rotating, translating, or modifying themoving picture according to the position, orientation, and movement ofthe marker

Such an operation will be described with reference to FIG. 5.

FIG. 5 is a flowchart illustrating the method of providing the deliveryitem information in the device according to another embodiment of thepresent disclosure.

Since the operations S301 through S305 in FIG. 5 are the same as theoperations from S201 through S205 in FIG. 4, detailed descriptionsthereof will be omitted for simplicity. After photographing andrecognizing the identification code, the device 100 may request themoving picture data corresponding to the identification code from theservice server 200 to receive the moving picture data (S307). Here, thedevice 100 may transmit the user identification information rather thanthe identification code to receive more customized moving picture datachosen in consideration of the user identification information among aplurality of moving picture data corresponding to the identificationcode.

Meanwhile, the device 100 continuously remains in a state that thecamera is activated and is photographing the identification code. Insuch a state, the device 100 having received the moving picture datafrom the service server 200 may recognize the identification code in thereal-time camera image and then search and track the marker in theidentification code (S309). After the marker is found and beingsearched, the device 100 may output the moving picture corresponding tothe moving picture data by superimposing the moving picture on thereal-time camera image based on the marker (S311). At this time, thedevice 100 may perform a transformation of the moving picture dependingon the position and orientation of the marker while continuouslytracking the position and orientation of the marker. For example, ifthere are four square-shaped markers, the device 100 may control theoutput operation by setting a playback frame enlarged by a certain scalewhich is determined based on the markers and playing back the movingpicture in the playback frame. The device 100 may continuously track themarkers, and performs the transformation of the moving picture such asthe rotation, translation, or scaling so that the moving picture cancertainly be played back within the playback frame. In another example,when a plurality of markers are extracted from the identification code,the device 100 may receive a plurality of moving pictures whichcorrespond to respective markers and output the plurality of movingpictures in correspondence with the positions of the respective markers.

The marker-based augmented reality technology that tracks the markercombines objects based on image recognition technology is well known inthe art, and a detailed description thereof will be omitted. It shouldbe noted that the non-marker-based augmented reality technique may beapplicable in another embodiment of the present disclosure.

Meanwhile, while the moving picture is output being superimposed on thereal-time camera image, the device 100 may continuously check whetherthere is a designated area in the moving picture (S313).

For example, when the device 100 outputs the moving picture data in theaugmented reality form, the device 100 may analyze frame by framewhether a specific object, e.g. a human object, exists in the movingpicture being played back. In case that there exists a human object inthe moving picture, the device 100 may check, with a support of theservice server 200, whether there is a designated area (e.g., hand,face, eye, and so on) and whether there is prescribed data correspondingto the designated area.

If there is a designated area and there is prescribed data correspondingto the designated area, the device 100 may receive the prescribed datafrom the service server 200 (S315), and combine the prescribed data inthe designated area of the moving picture which is being superimposed onthe real-time camera image to output the combined image (S317).

Such a feature may be applicable in following embodiments. In an examplein which the designated area is the mouth of the human object and theprescribed data is greetings, the device 100 may track the mouth of thehuman object and combine the greetings on the mouth area of the movingpicture. In another example in which the designated area is the palm ofthe human object and the prescribed data is product image information,the device 100 may track the palm of the human object and combine theproduct image on the palm area of the moving picture.

As described above, the method of providing the delivery iteminformation according to the present embodiment may further combineadditional information on a specific area of the moving picture when themoving picture is superimposed on the real-time camera image, therebyproviding the user with more lively and exotic information related withthe delivery item.

When security information is set in the prescribed data, the device 100may output the prescribed data only to an authorized user afterperforming the user verification process such as inputting a password,

FIG. 6 is a flowchart illustrating the method of providing the deliveryitem information in the device according to yet another embodiment ofthe present disclosure.

The operations S501 through S505 in FIG. 6 are the same as theoperations from S201 through S205 in FIG. 4, detailed descriptionsthereof will be omitted for simplicity. After photographing andrecognizing the identification code, the device 100 may request themoving picture data corresponding to the identification code. At thistime, when there are a plurality of moving pictures corresponding to theidentification code, the service server 200 may choose one of theplurality of moving pictures according to the user identificationinformation of the device 100 and transmit the moving picture datacorresponding to the chosen moving picture to the device 100.Alternatively, the service server 200 may transmit a moving picture listto the device 100, so that the user may choose one moving picture in thelist. When composing the moving picture list, the service server 200 maycompose an appropriate list according to the user identificationinformation of the device 100.

Upon receiving the moving picture list corresponding to theidentification code from the service server 200, the device 100 mayoutput the moving picture list by combining the moving picture list withthe real-time camera image. When the device 100 receives a user inputchoosing an advertisement moving picture in the moving picture list(S409), the device 100 may request the advertisement moving picture datafrom the service server 200 and receive the moving picture data tooutput the advertisement moving picture by superimposing on thereal-time camera image (S411). Subsequently, the device 100 may storecompensation information resulting from playing of the advertisementmoving picture and transmit the compensation information to the serviceserver 200 so that the service server 200 may accumulate pointscorresponding to the compensation information. Later, the user of thedevice 100 may use the accumulated points to purchase other goods orservices.

The configuration and operation of the device 100 according to anembodiment of the present disclosure have been described above. Now, theconfiguration and operation of the service server 200 according to anembodiment of the present disclosure will be described in detail.

FIG. 7 is a block diagram of a service server according to an embodimentof the present disclosure.

Referring to FIG. 7, the service server 200 may include an interfacemodule 210, a moving picture data control module 220, a service controlmodule 220, a user management module 240.

The interface module 210 transmits and receives information to and fromthe device 100 and the affiliated server 300 under a control of theservice control module 220. For example, the interface module 210 mayreceive the request for moving picture data corresponding to theidentification code from the device 100 to transfer to the servicecontrol module 220 and transmit, to the device 100, the moving picturedata transferred from the service control module 220. Also, theinterface module 210 may support an operation of uploading the movingpicture data, in response to a request of the device 100, to theaffiliated server 300 designated in the request. Further, the interfacemodule 210 may be interfaced with the affiliated server 300 of acarrier, for example, to exchange information necessary for performingthe method of providing the delivery item information.

The moving picture data control module 220 is in charge of generatingand maintaining of the moving picture data corresponding to theidentification code to be attached on the delivery item package. Here,the moving picture data refers to data representing the moving pictureassociated with the delivery item. For example, the moving picture datamay include at least one of: the detailed information of the deliveryitem such as the instruction manual, the specification, and orderdetails; and the advertisement information related with the deliveryitem such as the advertisement of the delivery item, the corporateadvertisement of the manufacturer, and the advertisement of the relatedproduct. In such a case, the moving picture data may be generated by themanufacturer of the delivery item, and the moving picture data controlmodule 220 may receive the moving picture data and matching each of themoving picture data with the identification code. Meanwhile, the movingpicture data may be a congratulatory message generated by the user. Insuch a case, the moving picture data control module 220 may provide asupporting service for generating and registering the moving picturedata to the device 100 of the orderer. For example, the moving picturedata control module 220 may provide the orderer device with a page forgenerating the moving picture, which page may support various additionalfunctions such as adding a sticker or a speech bubble that areapplicable when orderer generates the moving picture data. The movingpicture data generated in the orderer device may be stored in theservice server 200 to be transmitted to the receiver device later.

The service control module 220 performs overall control of the serviceserver 200 according to an embodiment of the present disclosure. Forexample, the service control module 220 may generate and maintain theidentification code. Here, the identification code may be generated foreach delivery item. Alternatively, the identification code may begenerated according to the type of delivery item, recipient, or anothercriteria. The service control module 220 may transmit the generatedidentification code to the affiliated server 300 of a carrier system, sothat the carrier outputs the identification code to attach on thedelivery item package instead of the waybill and delivers the deliveryitem package to the receiver by courier or mail.

The identification code may be the simple one-dimensional barcode, thetwo-dimensional barcode such as the QR code, the color bar code, or anyother variant of them. The identification code may contain informationfor accessing the service server 200, information for identifying andaccessing the corresponding moving picture data, or information foridentifying the recipient. The receiver of the delivery item may beidentified by recognizing the identification code.

The service control module 220 may store and maintain the moving picturedata generated correspondingly with the identification code by themoving picture data control module 220. When the request for the movingpicture data is received from the device 100, the service control module220 may retrieve the moving picture data and transmit the retrievedmoving picture data to the device 100.

At this time, the service control module 220 may check the useridentification information of the device 100 to choose one of theplurality of moving pictures according to the user identificationinformation of the device 100 and transmit the moving picture datacorresponding to the chosen moving picture to the device 100.Alternatively, the service control module 220 may compose a movingpicture list according to the user identification information andtransmit the list to the device 100 so that the user may choose onemoving picture in the list.

The user management module 240 may manage information about the users.The “users” used herein may include all the users who use the service ofproving delivery item information according to the embodiment of thepresent disclosure.

For example, in case that the user refers to a carrier who performs orcontrols the process of delivering the delivery item to a receiver bycourier or mail in connection with the service server 200, the usermanagement module 240 may store and maintain the information of thecarrier. In case that the user refers to a individual user whosubscribed to the service server 200 and wants to send a gift to a thirdparty and use the information providing method of the presentdisclosure, the user management module 240 may store and maintainsubscription information and device information of the user.

In case that the user refers to a user of the device owned by thereceiver of the delivery item, the user management module 240 may storeand maintain the user identification information matched with theidentification code. Here, the user of the receiver device may or maynot be subscribed to the service server 200. If the user of the receiverdevice is subscribed to the service server 200, the service server 200may support the service control module 230 to provide the user withcustomized moving picture data by using subscription information of theuser. If, however, the user of the receiver device is not subscribed tothe service server 200, the service server 200 may support the servicecontrol module 230 to provide the user with appropriate moving picturedata according to basic user details such as name, address, andtelephone number.

The detailed operation of the service server 200 according to anembodiment of the present disclosure will become more apparent fromflowcharts described below.

FIG. 8 is a flowchart illustrating a method of providing the deliveryitem information in the service server according to an embodiment of thepresent disclosure.

The service server 200 may receive the identification code recognized bythe device 100 which photographed and recognized the identification codethrough the activated camera as described above (S501). The serviceserver 200 may check the moving picture corresponding to theidentification code and transmit the moving picture data to the device100. Depending on the implementations, however, the service server 200may check the user identification information of the device 100 (S503),and extract a moving picture among a plurality of moving picturescorresponding to the identification code in accordance with the useridentification information (S505, S507) to transmit the moving picturedata of the extracted moving picture to the device 100 (S509).

Here, the user identification information may be received from thedevice 100. Meanwhile, in case that the user identification informationis stored in advance in the service server 200 being matched to theidentification code, the service server 200 may check the useridentification information by using the identification code receivedfrom the device 100.

On the other hand, the service server 200 may provide different movingpicture data to the device 100 depending on the user identificationinformation received from the device 100 even when the sameidentification code is contained in the request for the moving picturedata. For example, in case that the user of the device 100 is a deliveryman, the service server 200 may provide the device 100 with deliverydetails information. in case that the user of the device 100 is alegitimate receiver of the delivery item, the service server 200 mayprovide the device 100 with the moving picture data matched withidentification code. In case that the user of the device 100 is a thirdparty having no relation to the receiver of the delivery item, theservice server 200 may provide the device 100 with the advertisementmoving picture data matched with identification code.

Meanwhile, the service server 200 may check the address information ofthe user registered in the delivery system based on the useridentification information of the device 100, and provide the device 100with a targeted advertisement moving picture for a store in the vicinityof the user.

Also, the service server 200 may check or assume a propensity of theuser based on the user identification information of the device 100, andprovide the device 100 with the moving picture that may meet thepropensity of the user. For example, if the user of the device 100 is amale in this twenties, the service server 200 may provide theadvertisement moving picture targeted to males in their twenties.Further, the service server 200 may provide the device 100 with anadvertisement moving picture produced in an active game format or aview-only advertisement moving picture in consideration of the userpropensity.

The service server 200 may perform the user verification process toprovide the moving picture data only to the device 100 of an authorizeduser while providing a simple advertisement moving picture or a guidancemessage notifying that the user is unauthorized to the device 100 of theunauthorized user.

FIG. 9 is a flowchart illustrating the method of providing the deliveryitem information in the service server according to another embodimentof the present disclosure.

Referring to FIG. 9, the service server 200 may receive theidentification code recognized by the device 100 (S601). Also, theservice server 200 may check the user identification information of thedevice 100 (S603). The user identification information may be acquiredfrom the device 100 or may be found by using the identification code.

Afterwards, the service server 200 may check the moving picture storedin advance in the service server 200 correspondingly to theidentification code (SS605). At this time, the service server 200 cancompose a moving picture list when there are a plurality of movingpictures corresponding to the identification code (S607). The serviceserver 200 may transmit the moving picture data list to the device 100(S609). When a request for a specific advertisement moving picturechosen from the moving picture list is received from the device 100(S611), the service server 200 may transmit the correspondingadvertisement moving picture data to the device 100 (S613) so that thedevice 100 may output the advertisement moving picture by superimposingon the real-time camera image.

After checking that the advertisement moving picture is completelyplayed in the device 100 (S615), the service server 200 may accumulatethe compensation information or points of the user and store the updatedcompensation information correspondingly to the user identificationinformation.

The method of providing the delivery item information according to theembodiments of the present disclosure may be provided in a form of acomputer readable medium suitable for storing computer programinstructions and data. A non-transitory computer readable storage mediumaccording to an embodiment of the present disclosure may include aprogram which, when executed by a processor of a computer system, causesthe processor to execute a method of providing the delivery iteminformation. The method may include: activating a camera when anapplication program is executed; recognizing an identification codeattached on a delivery item and photographed by the camera; requestingmoving picture data corresponding to the identification code from aservice server and receiving the moving picture data; and outputtingmoving picture corresponding to the moving picture data by superimposingon a real-time camera image acquired by the camera.

The program recorded on the recording medium may be read and installedin the computer and executed to perform the above-described functions.

In order to allow a computer to read a program recorded on a recordingmedium and to execute functions implemented by the program, theabove-mentioned program may include codes that is written in computerlanguages such as C, C++, JAVA, and a machine language and can be readout by a processor through device interfaces of the computer.

Such codes may include a function code related to a function or the likethat defines the above-described functions, and may include an executionprocedure related control code necessary for a processor of the computerto execute the above-described functions according to a predeterminedprocedure. The codes may further include memory reference related codesas from which location (e.g. address) additional information or mediarequired for the processor of the computer to execute the abovedescribed functions should be referenced in the internal or externalmemory of the computer.

In addition, when the processor of the computer needs to communicatewith any other computer or server that is located in a remote site toexecute the above-described functions, the codes may further include acommunication-related code that represent how to communicate withanother computer or the server, and what information or media should betransmitted or received during communication.

The computer-readable media suitable for storing the computer programinstructions and data may include, for example, magnetic media such as ahard disk, a floppy disk, and a magnetic tape, optical media such as acompact disk read only memory (CD-ROM) and a digital video disk (DVD),magneto-optical medium such as a floptical disk, and semiconductormemories such as the ROM, the RAM, the flash memory, erasable andprogrammable ROM (EPROM), and electrically erasable and programmable ROM(EEPROM). The processor and memory may be supplemented by or integratedwith special purpose logic circuits.

The computer readable recording medium may be distributed to a pluralityof computer systems that may be connected by a network so that computerreadable code may be stored and executed in a distributed manner. Thefunctional program for implementing the present disclosure in thedistributed manner, and the related code and code segment may becontemplated and changed easily by programmers of the technical field ofthe present disclosure in consideration of this description and thesystem environment of the computer system with regard to reading andexecuting the program.

Each step in the embodiments of the present disclosure may beimplemented by computer-executable instructions to be executed by thecomputing system. As used herein, the term “computing system” or“computer system” is defined as one or more software modules operatingon electronic data, one or more hardware modules, or a combinationthereof. For example, the definition of the computing system includessoftware modules such as a personal computer's operating system andhardware components of a personal computer. The physical layout of themodule is insignificant. The computer system may include one or morecomputers connected through a network.

Similarly, the computing system may be implemented in a single physicaldevice in which an internal module such as a memory and a processoroperates in conjunction with performing an operation on the electronicdata.

That is, the devices for performing the method for providing thedelivery item information according to the present disclosure may beimplemented to perform the above-described embodiments based on thecomputing system described below.

FIG. 10 is a block diagram illustrating an operating environment of adevice for providing the delivery item information according to anembodiment of the present disclosure.

FIG. 10 and the following description are intended to provide a briefand general description of a suitable computing environment in which thepresent disclosure may be implemented. Although it is not required, thepresent disclosure may be described in connection withcomputer-executable instructions such as program modules that may beexecuted by a computer system. Generally, the program modules includeroutines, programs, objects, components, data structures, and so onsuitable for performing particular tasks or implementing particularabstract data types. The computer-executable instructions, associateddata structures, and program modules exemplify the program code meansfor carrying out processes described herein.

Referring to FIG. 10, an exemplary computing system suitable forimplementing the present disclosure may include a processing unit 11, asystem memory 12, and a system bus 10 that connects various systemcomponents including the system memory 12 to the processing unit 11.

The processing unit 11 is capable of executing computer-executableinstructions designed to implement the features of the presentdisclosure.

The system bus 10 may be any of several types of bus architecturesincluding a local bus, an external bus, and a memory bus. Alternatively,the system bus 10 may be any of the bus architectures employing a memorycontroller. The system memory 12 includes a read-only memory (ROM) 12Aand a random access memory 12B. A Basic Input/Output System (BIOS) 13Awhich includes basic routines that help information transfer betweencomponents within the computing system when the system is booted maygenerally be stored in the ROM 12A.

The computing system may include storage devices. For example, thecomputing system may include a hard disk drive 15 that reads informationfrom or writes information to a hard disk, a magnetic disk drive 16 thatreads information from or writes information to a magnetic disk, and anoptical disk drive 17 that reads information from or writes informationto an optical disk such as a CD-ROM and other optical medium. The harddisk drive 15, the magnetic disk drive 16, and the optical disk drive 17may be connected to the system bus 10 by a hard disk drive interface 18,a magnetic disk drive interface 19, and an optical drive interface 20,respectively.

Also, the computing system may further include an external memory 21 asone kind of the storage device. The external memory 21 may be connectedto the system bus 10 through an input/output (I/O) interface 24.

The above-described drives and the computer-readable media that may beaccessed by the drives allows nonvolatile storage of computer-executableinstructions, data structures, program modules, and other data. Theexemplary environment described herein illustrates the hard disk 15, themagnetic disk 16, and the optical disk 17, but other types ofcomputer-readable media for storing data such as a magnetic cassette, aflash memory card, a DVD, a Bernoulli cartridge, a RAM, and a ROM may beused as well.

The program code means including one or more program modules that may beloaded and executed by the processing unit 11 and includes an operatingsystem 13B, one or more application programs 13C, other program modules13D, and program data 13E may be stored in the hard disk 15, themagnetic disk 16, the optical disk 17, the ROM 12A or the RAM 12B.

Also, the computing system may receive commands and information from auser through input devices 22 such as a keyboard, a pointing device, amicrophone, a joystick, a game pad, and a scanner. These input devices22 may be connected to the processing unit 11 via the I/O interface 24connected to the system bus 10. The I/O interface 24 may logicallyrepresent at least one or a combinations of various interfaces such as,for example, a serial port interface, a PS/2 interface, a parallel portinterface, a USB interface, an Institute of Electrical and ElectronicsEngineers (IEEE) 1394 interface (i.e., FireWire interface), and otherinterfaces.

In addition, the computing system may further include a display device26 such as a monitor and a liquid crystal display (LCD), and an audiodevice 27 such as a speaker and a microphone. The display device 26 andthe audio device 27 may be connected to the system bus 10 through avideo/audio interface 25. Other peripheral devices (not shown) such as aspeaker and a printer, for example, may be connected to the computingsystem. The video/audio interface 25 may include a High DefinitionMultimedia Interface (HDMI) and Graphics Device Interface (GDI).

The computing system may be connected to a network such as, for example,an office wide area network (WAN) or an enterprise WAN, a home network,Intranet, and/or Internet. The computing system may exchange data withexternal sources such as, for example, a remote computer system, aremote application, and/or a remote database.

To this end, the computing system may include a network interface 28 forreceiving data from an external source and/or transmitting data to theexternal source.

The computing system may transmit and receive information to and from aremote device through the network interface 28. For example, in casethat the computing system refers to the first beacon device 200, thecomputing system may communicate with the service device 400 through thenetwork interface 28. On the other hand, in case that the computingsystem refers to the service device 400, the computing system mayexchanged information with the first beacon device 200 through thenetwork interface 28. The network interface 28 may represent a networkinterface card, or an equivalent software such as a network driverinterface specification (NDIS) stack, an equivalent hardware, and/or alogical combination of the software and hardware.

Likewise, the computing system may transmit and receive data to and froman external source through the I/O interface 24. The I/O interface 24may be connected to a modem 23 such as a standard modem, a cable modem,and a digital subscriber line (DSL) modem. The computing system maytransmit and receive data to and from the external source through themodem 23.

Although FIG. 10 shows an operating environment suitable for the presentdisclosure, the principles of the present disclosure may be applicableto any other system capable of implementing the principles of thepresent disclosure with an appropriate modifications, if necessary. Theenvironment shown in FIG. 10 is illustrative only and does not representeven a small portion of various environments in which the principles ofthe present disclosure may be implemented.

In addition, various information generated during the execution of theprogram according to the present disclosure may be stored and accessedin a computer-readable medium related with the computing system. Forexample, a portion of these program modules and a portion of theassociated program data may be included in the operating system 13B, theapplication program 13C, the program module 13D, and/or the program data13E to be stored in the system memory 12.

Further, when a mass storage device such as the hard disk is connectedto the computing system, such program module and related program datamay be stored in the mass storage device. In a networked environment,the program modules associated with the present disclosure, or portionsthereof, may be stored in a remote computer system (e.g. a system memoryrelated with a computing system of the first beacon device 100 and theservice device 400, or a remote memory device such as a mass storagedevice) connected via the I/O interface 24 and the modem 23 or thenetwork interface 25. The execution of such a module may be performed ina distributed environment as described above.

While the present specification contains a number of specificimplementation details, it should be understood that they are not to beconstrued as limitations on the scope of any disclosure or claims, butas a description of features that may be specific to a particularembodiment of a particular disclosure. Certain features described withrespect to contexts of independent embodiments may be implemented incombination in a single embodiment. Conversely, various featuresdescribed in the context of a single embodiment may also be implementedin other embodiments either individually or in any suitablesub-combination. Further, although some features may be described tooperate in a particular combination and may be initially depicted as soclaimed, one or more features from the claimed combination may in somecases be excluded from the combination, and a claimed combination may bereplaced by a sub-combination or a variant of the sub-combination.

Similarly, although the operations are depicted in the drawings in aparticular order, it should not be understood that such operations needto be performed in that particular order or sequential order shown toachieve the desired result or all the depicted operations should beperformed. In certain cases, multitasking and parallel processing may beadvantageous. Also, the fragmentation of the various system componentsin the above-described embodiments should not be understood as requiringsuch fragmentation in all embodiments, and the program components andsystems described above may generally be integrated together into asingle software product or packaged into a multiple-function softwareproduct.

Although specific embodiments of the subject matter have been describedherein, other embodiments are within the scope of the following claims.For example, the operations defined in the claims may be performed in adifferent order to still achieve desirable results. By way of example,the process illustrated in the accompanied drawings does not necessarilyrequire that particularly illustrated sequence or sequential order toachieve the desired result. In certain implementations, multitasking andparallel processing may be advantageous.

The descriptions set forth above disclose the best mode of the presentdisclosure, and is provided to illustrate the disclosure and to enablethose skilled in the art to make and use the disclosure. The writtendescription is not intended to limit the disclosure to the specificterminology presented. Thus, although the present disclosure has beendescribed in detail with reference to the above examples, those skilledin the art will be able to make adaptations, modifications, andvariations on the examples without departing from the scope of thepresent disclosure.

Accordingly, the scope of the present disclosure should not be limitedby the illustrated embodiments but should be defined by the appendedclaims.

According to the present disclosure, the receiver of the delivery itemmay photograph the identification code attached on the delivery itempackage and view the moving picture corresponding to the delivery itemin the augmented reality form. Thus, the user may intuitively and easilycheck the contents and condition of the delivery item.

The apparatus according to the present disclosure may discriminate thelegitimate user who photographs the identification code by the deviceand provide appropriate moving picture to the user. Thus, the presentdisclosure enables the carrier to ship and deliver item packages withoutexposure of the personal information, provides users with the unusualexperience, and contribute to the development of shipping and deliveryindustries.

The present disclosure is industrially applicable because it canactually be implemented obviously and has a sufficiently highpossibility of commercialization or sales.

The description of the disclosure is exemplary in nature and, thus,variations that do not depart from the substance of the disclosure areintended to be within the scope of the disclosure. Such variations arenot to be regarded as a departure from the spirit and scope of thedisclosure.

What is claimed is:
 1. A method of providing delivery item informationin a device, comprising: activating a camera to capture images;detecting, in the captured images, an identification code attached to adelivery item; detecting presence of a predetermined body part of ahuman object in the captured images; sending a request for movingpicture data corresponding to the identification code and thepredetermined body part to a service server; receiving the movingpicture data from the service server responsive to sending the request;generating a moving picture by superimposing the moving picture data onportions of the captured images corresponding to the predetermined bodypart; and outputting the moving picture.
 2. The method of claim 1,wherein the moving picture data comprises at least one of detailedinformation of the delivery item, advertisement informationcorresponding to the delivery item, or information designated by a user.3. The method of claim 1, further comprising tracking a position ofmarker to translate or rotate playback frame of the moving picture databased on the position of the marker.
 4. The method of claim 1, whereinsending the request comprises: transmitting, to the service server, useridentification information.
 5. The method of claim 4, wherein the useridentification information comprises at least one of a phone numberassigned to the device, facial identification information recognizedthrough a front camera, or biometric information recognized through abiometric module.
 6. The method of claim 1, wherein sending the requestcomprises: receiving a moving picture list corresponding to theidentification code from the service server; displaying the movingpicture list by combining the moving picture list with the capturedimages; and in response to a user input selecting a specific movingpicture, requesting specific moving picture data corresponding to thespecific moving picture from the service server as the requested movingpicture data.
 7. The method of claim 1, wherein the predetermined bodypart is a mouth or a palm.